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(54) Traffic allocation on virtual trunks 

(57) A data network using a maximal flow algorithm 
uses all available paths between a source and a desti- 
nation, providing a more efficient use of the network than 
the shortest path networks. To facilitate the exchange of 
network status information, particularly in a maximal 
flow context, a plurality of parallel paths formed of one 
or more nodes 2001... 2017 and node links 3001 ... 
3020, are formed into groups 4001 ... 4003 connected 



by group links 5001 , 5002. The paths within a group be- 
tween the group links are notionally reduced to a single 
equivalent, 6001 ... 6003, path with the aggregate dy- 
namic capacity of the individual paths. In this way the 
network can be reduced to a serial connection of links 
between source and destination. Preferably a node in 
each group 4001 ... 4003 provides group status infor- 
mation to the other groups to enable each group to de- 
termine the overall traffic status of the network. 
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Description 

Technicai Field 

[0001] This invention provides an improved traffic 
routing tool. 

Background Art 

[0002] In data networks, particularly those carrying 
traffic having a guaranteed quality of service, a known 
method of determining the route of traffic across a net- 
work is the shortest path method which requires that 
each terminal have a map of the network so that the path 
with the least number of links between the sending and 
receiving terminals can be determined. Our invention, 
described in Australian Patent application No. 44470/99 
(Docket No. 127045), entitled "Maximal Flow Data Rout- 
ing" describes an improved path selection algorithm 
which distributes the traffic over all practical available 
links between the sender and receiver. 
[0003] Our co-pending Australian Application No. 
47400/99 (Docket No. 127064) entitled "Recursive Traf- 
fic Distribution IP/Data Network Model" describes a data 
structure for reporting the load status of the network, for 
use in distributing traffic to links so that traffic is prefer- 
entially assigned to the more lightly loaded links. 

Disclosure of the Invention 

[0004] This invention facilitates the determination of 
the network load status by treating parallel paths as a 
single link. 

[0005] Preferably one of the nodes in each group of 
parallel paths is designated as a master node and col- 
lates the load status for the nodes and links in the des- 
ignated group, and broadcasts an overall load status re- 
port for the group. 

[0006] Each group of nodes and links is connected to 
an adjacent group via at least one inter-group link. The 
receiving node of each group, i.e. the node connected 
to the inter-group link, has available to the details of the 
load status of all the other nodes and links in its group 
and uses the load sharing algorithm to distribute the traf- 
fic across the paths within the group. 
[0007] This process reduces the amount of load sta- 
tus report traffic on the network, and simplifies the rout- 
ing of a message across the network. It is not necessary 
for the sending node to have detailed load status data 
for each node and link in the network. Routing and dis- 
tribution across a group is carried out by the inter group 
link node which receives the traffic. 

Brief Description of the Invention 

[0008] 

Figure 1 represents a network of nodes and links. 
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Figure 2 represents a network including notional 
links produced by notionally combining par- 
allel paths in accordance with an embodi- 
ment of this invention. 

Figure 3 represents a group of nodes. 

Figure 4 represents header information utilized in 
implementing an embodiment of the inven- 
tion. 

Figure 5 represents a schematic arrangement for 
routing traffic according to an embodiment 
of the invention. 



Best Method of Carrying out the Invention 

[0009] Figure 1 represents a network of nodes 
2001 ... 2017, interconnected by node links 3001 to 
20 3019. The nodes are arranged in groups 4001, 4002, 
4003. The groups are interconnected by group links 
5001,5002. 

[0010] Generally speaking, each group of nodes will 
provide at least one, and usually multiple paths across 
25 the group from one group link to another group link. 
[0011] In the embodiment shown in Figure 3, a group 
4004 is illustrated, and the nodes have been labelled as 
follows: 

30 2410 = A4 
2411 = C4 
2412= B4 
2413 = D4 

35 When traffic enters group 4004 via group link 5402 it 
may be directed to an internal node or it may transit the 
group towards node E4 or node F4 on corresponding 
group links 5403 and 5404. In the case where nodes E4 
and F4 belong to different groups the path selection is 

^0 as follows. 

[0012] Traffic directed to E4 has 3 possible paths: 
A4.B4.E4, A4.C4.B4.E4, A4.D4.B4.E4. 
[0013] None of these paths use the same internal 
node links within the group. 

45 [0014] Traffic directed to F4 has 3 possible paths: 

A4.D4.F4, A4.B4.D4.F4, A4.C4.B4.D4.F4. 
[0015] The same link B4D4 is used in the second and 
third of these paths. To optimize the traffic across the 
groups to E4, node A needs to determine whether path 

so A4B4 or path A4C4B4 has the greater available capac- 
ity, and, where latency is critical as determined by the 
priority of the traffic, which path meets the latency re- 
quirements. To enable a node to determine these fac- 
tors, each message header should include priority infor- 

55 mation in addition to destination and origin information. 
Preferably, time information is associated with each 
message. The time information may be an absolute time 
stamp (the time when the message was initially trans- 
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mined), or sequence information ( the sequence of the 
block of data in an overall message). Additionally, time 
information may include the time when the data was re- 
ceived at the node. ( relative time information). 
[0016] Where traffic is directed towards F4, A4 has 
three choices A4D4, A4B4D4. A4C4B4D4, but the sec- 
ond and third choices include the same link B4D4, as- 
suming that all the links have the same available capac- 
ity, the load should be distributed 50% to A4D4, 25% 
A4B4D4, and 25% A4C4B4D4, rather than 1/3 to each 
because of the common link. The actual load status of 
each link would then be taken into consideration to de- 
termine the actual load distribution. For example if link 
A4D4 were fully loaded and link A4B4 had half the avail- 
able capacity of links A4C4 & C4B4, 2/3 Of the traffic 
should be assigned to A4C4B4D4 and 1/3 to A4B4D4. 
[0017] The above example illustrates the factors 
which a group master node would take into account is 
determining the available capacity across the group 
from one group link to another. 

[0018] Using the all practical paths distribution de- 
scribed in our Application No. 44470/99 (Docket No. 
127045), the network between two terminals A, con- 
nected to node 2001 in Group 1 (4001 ) and B connected 
to node 2017 in Group 3 (4003), the network between 
A & B can be condensed to a series of nodes and links 
as shown in Figure 2. 

[0019] As shown in Figure 2, each group, 4001, 4002, 
4003, is reduced to a pair of nodes, 2001/2005, 
2006/2011, 2012/2017, interconnected by correspond- 
ing hypothetical equivalent single links 6001, 6002, 
6003. 

[0020] The hypothetical links represent the available 
useable capacity between the corresponding nodes. 
[0021] Thus link 6001 represents the available usea- 
ble capacity on the paths between node 2001 and node 
2005 Of Group 1 . 

[0022] Our Application No. 47400/99 (127064) dis- 
closes a technique where each node and link in a group, 
and at least one node in each group receives overall 
load status information for each other group or aggre- 
gation of groups in the network. This information is suf- 
ficient to enable the hypothetical equivalent links to be 
constructed. 

[0023] Figure 4 illustrates header information which 
may be included in the message packets to facilitate re- 
constitution of the message after transmission across a 
network using the "all paths" technique. Typically the in- 
formation may include: 

Originating address; 
Destination address; 
Priority; 

Message Number; 
Packet Sequence number; 

[0024] Figure 5 illustrates schematically a mechanism 
within a node for distributing incoming messages to out- 



going links. 

[0025] Incoming messages on link 51 are stored in 
buffer 52 for transmission to other links or nodes 53, 54, 
55. 

5 [0026] Control means receives the header informa- 
tion and uses the destination, time stamp, priority, tem- 
porary buffer address of a message etc to determine the 
output to which a message is to be connected. The con- 
trol means also has access to network map and load 

10 status information 57, and decides how much traffic can 
be allocated to each link. 

[0027] To determine the capacity available between 
node 2001 and 2005, assume that the link between 
3001 has a capacity C1 , link 3002 has a capacity C2, 
15 link 3003 has capacity C3, link 3004 has capacity C4, 
link 3005 has capacity C5, and link 3006 has capacity 
C6, and that all nodes are non-blocking. 
[0028] Thus there are 3 paths having the following 
links: 

20 

Path 1 = 3001, 3002, 3003 
Path 2 = 3004, 3003 
Path 3 = 3005, 3006 

25 [0029] If C3 > (C2 + C4), both paths 1 and 2 are fully 
available, and limited respectively by the smallest ca- 
pacity link in each path. Suppose that C2 is the smallest 
capacity link in Path 1 . Then the maximum capacity of 
Path 1 is C2. Similarly, where C4< C3, C4 is the smallest 

30 capacity link in Path 3. Thus the overall maximum ca- 
pacity between 2001 and 2005 is C2+C4+C5. 
[0030] This maximum capacity varies with the loads 
on the links, and this load information is exchanged be- 
tween the nodes of a group. Because there may be both 

35 intra-group and transgroup traffic, the smallest link in a 
path may not be the limiting factor in a path if the traffic 
on one of the other links in the path reduces its available 
capacity. 

[0031] Because the load status information of all the 
40 links in a group is available and regularly updated, the 
available capacity of the equivalent link can be calculat- 
ed. For example, in the equivalent link limited by C2, C4 
and C5. assume that C2 has 60% available capacity, C4 
has 75% available capacity and C5 has 100% available 
capacity. The overall available capacity of the notional 
equivalent link, CE, is calculated as follows: 

CE = 0.6 C2 + 0.75 C4 + C5 

50 

[0032] More generally, 

CE = x 1 .C 1 +x 2 .C 2 + ...+x n .C n 

55 

[0033] Where x n C n is the available capacity of the link 
having the least available capacity in Path n, x n being 
the available fraction of the link having capacity C n . 



3 



EP 1 091 530 A2 



Claims 



A traffic routing tool for use in a network of nodes 
interconnected by node links in which groups of 
nodes are interconnected by group links, s 

wherein the tool dynamically determines the 
available traffic capacity between a source and 
a destination using all practical paths, 



wherein, within each group of nodes is notion- 
ally reduced to a corresponding equivalent link 
between an associated pair of nodes in the 
source/destination path, the equivalent single 
path representing the available capacity be- 
tween the associated pair of nodes. 



w 



15 



A traffic routing arrangement substantially as herein 
described with reference to the accompanying 
drawings. 

A traffic routing tool substantially as herein de- 
scribed with reference to the accompanying draw- 
ings. 

A method of routing traffic substantially as herein 
described with reference to the accompanying 
drawings. 



A method for routing traffic in a network of nodes 
interconnected by node links in which groups of 
nodes are interconnected by group links, 20 

wherein the tool dynamically determines the 
available traffic capacity between a source and 
a destination using all practical paths, 



wherein, within each group of nodes is notion- 
ally reduced to a corresponding equivalent link 
between an associated pair of nodes in the 
source/destination path, the equivalent single 
path representing the available capacity be- 
tween the associated pair of nodes. 



25 



30 



3. A traffic routing arrangement for routing each mes- 
sage on an incoming link to one or more outgoing 
links, the arrangement including: 35 

buffer means to store incoming message; 



control means to determine the destination of 
each incoming message from destination infor- 
mation in the message header; 



40 



the control means having access to network 
layout information and network load status in- 
formation; 45 



whereby the traffic routing arrangement routes 
each message to one or more output links on 
the basis of all practical paths to the destination 
determined from the, destination information, 
the network layout information, and the network 
load status information. 



50 



An arrangement as claimed in wherein the network 
information includes notional equivalent links rep- 
resenting the available capacity of groups of parallel 
paths. 
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(54) Traffic allocation on virtual trunks 



(57) A data network using a maximal flow algorithm 
uses all available paths between a source and a desti- 
nation, providing a more efficient use of the network than 
the shortest path networks. To facilitate the exchange of 
network status information, particularly in a maximal 
flow context, a plurality of parallel paths formed of one 
or more nodes 2001... 2017 and node links 3001 ... 
3020, are formed into groups 4001 ... 4003 connected 



by group links 5001 . 5002. The paths within a group be- 
tween the group links are notionally reduced to a single 
equivalent, 6001 ... 6003, path with the aggregate dy- 
namic capacity of the individual paths. In this way the 
network can be reduced to a serial connection of links 
between source and destination. Preferably a node in 
each group 4001 ... 4003 provides group status infor- 
mation to the other groups to enable each group to de- 
termine the overall traffic status of the network. 



CO 
< 

o 

CO 
IO 

o> 
o 



Q. 
LU 



4001 GROUP 1 



GROUP 2 4002 



GROUP 3 
4003 




FIGURE 1 



Printed by Jouvc, 75001 PARIS (FR) 



EP 1 091 530 A3 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 00 44 0242 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation ol document with indication, where appropriate, 
of relevant passages 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION <wt.CI.7) 



A 

X 



EP 0 348 328 A (IBM) 

27 December 1989 (1989-12-27) 

* figures 1,9,10 * 

* page 2, line 1 - page 3, line 12 * 

* page 6, line 10-25 * 

US 5 949 788 A (FRIEDMAN G ST0DEL ET AL) 
7 September 1999 (1999-09-07) 

* abstract * 

* figure 1 * 

* column 1, line 15 - column 2, line 13 * 



W0 99 22492 A (ERICSSON TELEF0N AB L M 
;TJAEDER J0HAN (SE); NORDENSTAM YNGVE 
(SE)) 6 May 1999 (1999-05-06) 

* abstract * 

* figures 1,2,9-11 * 
page 1, line 20 - page 3, line 23 * 
page 4, 1 ine 19-24 * 
page 6, line 28 - page 8, line 11 * 
page 10, line 26-36 * 
page 11, line 25-29 * 



1-7 



H04L12/56 



1,2,5-7 



3,4 
3-7 



TECHNICAL FIELDS 
SEARCHED (tnt.CJ.7) 



1,2 



H04L 



The present search report has been drawn up for all claims 



Pbc*of sesjctt 

MUNICH 



Data ol oor-.pJotto n of the se&rcrt 

18 July 2002 



Examine! 

Gabriel , C 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant it taken alone 

Y : particularly relevant if co nbkned with ar other 

document of tt*e same category 
A : technotogJca! background 
O : non-written disclosure 
P : intermediate document 



T : theory or principle underlying tie inverrjon 
E : earler patent document but published on, or 

after me filing date 
D : docomeri died in tie application 
L : document cited tor other reasons 

A : nie-nber of the same palen: tamiiy. <»nesponding 
rirvaiment 



2 



EP 1 091 530 A3 




European Patent 
Office 



LACK OF UNITY OF INVENTION 
SHEET B 



EP 00 44 0242 



Application Number 



The Search Division considers that the present European patent application does not comply with the 
requirements of unity of invention and relates to severaHnventlons or groups of inventions, namely: 

1. Claims: 1,2,6,7 

Apparatus or method for improving routing of traffic by 
dynamically determining the total traffic capacity between a 
source and destination and by reducing this information to 
an equivalent single path. 



2. Claims: 3-5 

Apparatus or method for routing traffic based on 
destination, network layout, and network load. 



3 



EP 1 091 530 A3 



ANNEX TO THE EUROPEAN SEARCH REPORT 
ON EUROPEAN PATENT APPLICATION NO. 



EP 00 44 0242 



This annex lists the patent family members relating to the patent documents cited in the above-mentioned European search report 
The members are as contained in the European Patent Office EDP file on 

The European Patent Office Is 'm no way liable for these particulars which are merely given tor the purpose of information . 

18-07-2002 



Patent document 
cited In search report 



Publication 
date 



Patent family 
member(s) 



Publication 
date 



EP 0348328 



27-12-1989 



US 
0E 
DE 
EP 
JP 
JP 
JP 



4967345 A 
68920490 01 
68920490 T2 
0348328 A2 
1958796 C 
2041054 A 
6093681 B 



30-10-1990 
23-02-1995 
20-07-1995 
27-12-1989 
10-08-1995 
09-02-1990 
16-11-1994 



US 5949788 



M0 9922492 



07-09-1999 68 
W0 

06-05-1999 DE 
AU 
WO 



2340004 A ,B 
9851050 Al 

19746904 Al 
1231499 A 
9922492 Al 



09-02-2000 
12-11-1998 

27-05-1999 
17-05-1999 
06-05-1999 



i For more details about this annex : see Official Journal of the European Patent Office. Ho. 1 2/82 



BMsnncirv <fp inouurua i - 



4 



